arXiv:1509.03262vl [math.OC] 10 Sep 2015 


1 


A Satisfiability Modulo Theory Approach to Secure State 
Reconstruction in Differentially Flat Systems Under Sensor Attacks 

Yasser Shoukry, Pierluigi Nuzzo, Nicola Bezzo, 

Alberto L. Sangiovanni-Vincentelli, Sanjit A. Seshia, and Paulo Tabuada 


Abstract 

We address the problem of estimating the state of a differentially flat system from measurements that may be corrupted by an 
adversarial attack. In cyber-physical systems, malicious attacks can directly compromise the system’s sensors or manipulate the 
communication between sensors and controllers. We consider attacks that only corrupt a subset of sensor measurements. We show 
that the possibility of reconstructing the state under such attacks is characterized by a suitable generalization of the notion of 
s-sparse observability, previously introduced by some of the authors in the linear case. We also extend our previous work on the 
use of Satisfiability Modulo Theory solvers to estimate the state under sensor attacks to the context of differentially flat systems. 
The effectiveness of our approach is illustrated on the problem of controlling a quadrotor under sensor attacks. 


I. Introduction 

The increasing dependence on sensors and cyber components (e.g. digital processors and networks) to monitor and control a 
broad range of today’s critical infrastructures is at the outset of unprecedented vulnerabilities and malicious attacks. A striking 
example of such attacks is the Stuxnet virus targeting SCADA systems m. In this attack, sensor measurements are replaced by 
previously recorded data, which, once they are fed to the controller, can lead to catastrophic situations. Other examples include 
the injection of false data in “smart” systems Q, and the non-invasive sensor spoofing attacks in the automotive domain 13. 

To secure these cyber-physical systems, a possible strategy is to exploit an accurate mathematical model of the dynamics of 
the physical system under control, and analyze any discrepancy between the actual sensor measurements and the ones predicted 
by the model, to decide about the existence of an adversarial attack a, 0 . Once the malicious sensors, if any, are detected 
and identified, it is then possible to estimate the actual system state by using the data collected from the attack-free sensors. 
In the following, we refer to this approach as secure state reconstruction. 

The problem of state reconstruction in the presence of disturbances, in its general form, has attracted considerable attention 
from the control community over the years. Previous work addresses the problem in terms of robust filter (estimator) design 
against outliers 0, 0, 0. However, the lack of a priori knowledge about the attack signals tends to limit the applicability 
of robust estimation techniques to security problems. In secure state reconstruction, no assumptions are usually made about 
the attacks, e.g., in terms of their stochastic properties, time evolution, or energy bounds. 

A game theoretic formulation for the secure state reconstruction problem has been proposed in the literature, when the 
physical system is scalar 0. An alternative reconstruction technique, still in the context of a scalar system equipped with one 
sensor, has also been derived based on the analysis of the performance degradation of a Kalman filter when the sensor is under 
attack Qo). Finally, the general case of a multidimensional system equipped with multiple sensors has been tackled mi, 0 , 
mi, mi, ca, ma, m, mi, mi when the attackers are restricted to corrupt an unknown subset of the system sensors. 
However, all of the above contributions focus on problems for which the underlying dynamics can be described by a linear 
system. 

Unlike previous work, we focus in this paper on the problem of secure state reconstruction for a class of nonlinear systems. 
Specifically, we consider physical systems whose dynamics can be described by a differentially flat system HU. Differentially 
flat systems represent an important class of nonlinear systems, in that they encompass a wide range of mechanical systems, 
including several examples of ground and aerial vehicles. 

While differentially flat systems can be converted into linear systems using dynamic feedback linearization and a change of 
coordinates, this technique would, however, require the knowledge of the system state. Since this is clearly our ultimate goal, 
it is not possible to directly apply the results from linear secure state reconstruction to differentially flat systems. We follow 
instead a different approach, by extending the notion of s-sparse observability HU, mi from linear systems to nonlinear 
systems. Similarly to linear systems, we show that s-sparse observability provides a necessary and sufficient condition for the 
full reconstruction of the state regardless of the attack. Resting on this concept, we can then build on our previous work on 
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sound and complete secure state reconstruction for linear systems ca, m, to develop an algorithm that can efficiently identify 
the corrupted sensors by leveraging Satisfiability Modulo Theory (SMT) solving to tackle the combinatorial aspects of 
the problem. We illustrate our algorithm on the problem of controlling and stabilizing a quadrotor, while some of its sensors 
are under attack. 

The rest of this paper is organized as follows. Section [n| formulates the secure state reconstruction problem. In Section III 


we generalize the notion of s-sparse observability to nonlinear systems and then show that it is the necessary and sufficient 
condition to reconstruct the state in spite of the attack. Section|^presents the generalization of our previous SMT-based attack 
detection and reconstruction algorithm to differentially flat systems. In Section [V] we discuss its application to the quadrotor 


case study. We Anally draw some conclusions in Section VI 


II. The Secure State Reconstruction Problem 

A. Notation 

The symbols N, K and B denote the sets of natural, real, and Boolean numbers, respectively. If S' is a set, we denote by 
|S| its cardinality. The support of a vector x S K", denoted by supp(x), is the set of indices of the non-zero components of 
X. Similarly, the complement of the support of a vector x is denoted by supp(a;) = {1,... ,n} \ supp(a:). We call a vector 
X G M” s-sparse, if x has s nonzero elements, i.e., if |supp(a;)| = s. 

Let /:!&”—)• M"* be a function given by f{x) = ..., fmix)), where /^ : K” —>• K is the ith component of /. Then, 

for the set T C {!,... ,m}, we denote by /r the vector function obtained from / by removing all the components except 
those indexed by T. Similarly, /p is obtained from / by removing the components indexed by T. Finally, we use the notation 
Va;/ to denote the Jacobian matrix of / evaluated at x. 


B. Dynamics and Attack Model 
We consider a system of the form: 




(II. 1) 


where G <T C M" is the system state, gU C K™ is the system input, and G is the observed output, all at time 
t G N. The map f : X x U —i' X represents the system dynamics. We will use the notation fu{x) = f{x,u) in the remainder 
of this paper. We also use the notation fukUk-i...ui{x) to denote the A:-fold composition of /, i.e.. 


fu^uk-l...u^{x) = /(/(/(/a;) ,...) . 

An attacker corrupts the sensor measurements y by either spoofing the sensor outputs, or by manipulating the data transmitted 
from the sensors to the controller. Independently of how the attack is implemented, its effect can be described by the s-sparse 
vector G If sensor i G {I,... ,p} is attacked then the ith component of is non-zero; otherwise the ith sensor is 
not attacked. Hence, s describes the number of attacked sensors. We make no assumptions on the vector other than being 
s-sparse. In particular, we do not assume bounds, statistical properties, or restrictions on the time evolution of the elements in 
While the value of s is not known, we assume the knowledge of an upper bound s on it. 


C. Problem Formulation 

Solving the secure state reconstruction problem implies estimating the state x from a set of measurements collected over a 
window of length r G N. Hence, we start by grouping the measurements from the jth sensor as: 

+ 4*^ (n.2) 
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where, with some abuse of notation, Yi, Ei and Hu,i are used to denote the zth block of and H^, respectively. Using 

the same notation, we denote by YpjEr, and r the blocks indexed by the elements in the set F. Moreover, for simplicity, 
we drop the time t argument in the following, since we assume that the secure state reconstruction problem is to be solved at 
every time instance. 

Let {x*,E*) denote the actual state of the system and the actual attack vector. Let also b* S be a vector of binary 
indicator variables such that b* = 0 when the ith sensor is attack-free and bi = 1 otherwise. It follows from ( |IL21 i that: 

ifb*=0 

* \h^4x*) + E* ifb* = l. 

Therefore, we are interested in a state estimate x and a vector of binary indicator variables b = (6i,... ,bp) such that the 
discrepancy between the collected measurements Yi and the expected outputs Hu^i{x) is zero for all the sensors that are labeled 
as attack-free sensors (b* = 0). Furthermore, the estimated state x should be equal to x*. These requests can be formalized as 
follows. 


Problem II.l. (Secure State Reconstruction) For the control system under attack Eq (defined in ( |II.l| ij, construct the estimate 
rj = (x,b) S K” X fiJ’ such that rj \= (i.e., rj satisfies the formula (p), where: 






2 
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» A Eixfi 


(11.3) 


subject to (a;* = a:) A (supp(6*) C supp(6)). 

The second clause in the formula rules out the trivial solution in which all sensors are labelled as attacked, by enforcing 
a cardinality constraint on the number of attacked sensors, which is required to be bounded by s. 

As in the case of linear systems 061, the secure state reconstruction problem formulation in Problem |IL1| does not ask for 
a solution with the minimal number of attacked sensors. However, as shown in na, it is possible to obtain the minimal set of 
sensors under attack by invoking a solver for Problem II.l multiple times. In the next section, we characterize the conditions 
that guarantee the existence of a solution for this problem. 


III. s-Sparse Observability 


For linear systems, the notion of s-sparse observability plays a key role in determining the existence of a 
Problem In this section, we generalize this notion to the case of nonlinear systems. To do so, we 

attack-free discrete-time nonlinear system of the form: 


solution for 
consider an 


= h (xW) 


(III.l) 


and recall the general definitions of indistinguishability and observability. 


Definition III.l (Indistinguishability). We say that two states x,x' G X of system E are indistinguishable/rom measurements 
collected from the set of sensors indexed by F over a window of length t, and we write x If x' if for every sequence of 
controls ..., G IR™ we have Hu,t{x) = Hu^rix'). 


Definition III.2 (Observability). A state x G X of system E is said to be observable using measurements collected from the 
set of sensors indexed by F over a window of length t (^(r^Tfobservable for short), if for each x' G X, x If. x' implies 
X = x'. 


Definition III.3. A system E is said to be (r, F)-observable if all the states x G X are (T,T)-observable. 

We can now define the notion of s-sparse observability as follows. 

Definition III.4 (s-Sparse r-Observable System). The nonlinear control system E, defined in pil.l| i, is said to be s-sparse 
T-observable if for every set F C {1,... ,p} with |F| = s, the system E is (r, T)-observable, where F = {1,... ,p} \ F. 

In other words, a system is s-sparse r-observable if it is r-observable from any choice of [p — s) sensors. 


A. s-Sparse Observability and Secure State Reconstruction 

Similarly to linear systems, we show that 2s-sparse observability is a necessary and sufficient condition for the existence 
of a solution of the secure state reconstruction problem. To do so, we start by showing an intermediate result, stating that the 
correct reconstruction of the system state implies correct estimation of the attack support. To simplify the notation, we also 
drop the subscript u in all of the proofs. 
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Proposition IIL5. For any pair p = (x, b) that satisfies in (im (i.e., such that ij ^ (j)), the following holds: 

X* = X ^ supp(b*) C supp{b). 


Proof: The result follows from the fact that the first set of clauses in f enforces: 
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supp(b) 


= 0 


where the last implication follows from x and x* being equal. The last equality implies that the attack vector E*, after removing 
the sensors indexed by the estimate set supp( 6 ), is equal to zero; hence, we conclude that supp( 6 *) C supp( 6 ). ■ 

Now we can state the main result of this section as follows. 

Theorem III.6. For any pair rj = (x, b) that satisfy f in dini ) the following holds: 

X* = X A supp{b*) C supp{b) 

if and only if the dynamical system defined by ([ig is 2s-sparse r-observable. 

Proof: We need to show that 2s-sparse r-observability is a necessary and sufficient condition for x = x* to hold. Once 


this is established, supp(h*) C supp( 6 ) follows from Proposition III.5 


We assume for the sake of contradiction that there exists a pair p = {x,b) that satishes f, and such that x ^ x*, while the 
system is 2s-sparse r-observable. Then, the hrst set of clauses in f implies that: 
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i is also equal to zero. 
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( 111 . 2 ) 


where the implication (a) follows by using the equality ( |II.2| l, along with the fact that E* —being zero implies that 


supp(6)Usupp(6*) 

However, by the second clause in f we know that the cardinality of supp(5) is at most s, hence the cardinality of 
|supp( 6 ) U supp(h*)| is at most 2s. Equality ( |III.2| i would then imply that x and x* are indistinguishable using p — 2s sensors, 
which in turn implies that the system is not 2 s-sparse r-observable, a contradiction with respect to our original assumption. 

Conversely, if the system Ea is not 2s-sparse r-observable then there exists a vector x with x x* which is indistinguishable 
from X*, when using p — 2s sensors. This in turn implies that Hr{x*) = Hr{x) for some T that have cardinality p — 2s. 
Hence, we can define two indicator variables b and b* such that T = supp( 6 ) U supp(5*), |supp(&)| = s and |supp(5*)| = s. 
We can also dehne the attack vector E* as : 

'^siipp(b*) ~ Hsupp(b*){x) — Hsupp[b*){x ). 

Then, using the above dehnitions, together with the assumption Hr{x*) = Hr{x), we obtain: 
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which implies that there exists an estimate 77 = (x, b), with x x* that also satishes f. 
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B. Differential Flatness and s-Sparse Flatness 

For the rest of this paper, we consider a special class of nonlinear systems known as differentially flaJ^systems. A system 
is differentially flat if the state and the input can be reconstructed from current and previous outputs. More formally, 

Definition III.7 (Differential Flatness). System is differentially flat if there exist an integer k € N, and functions a and /?, 
such that the state and the input can be reconstructed from the outputs as follows: 

= /3 ... ,2/'*-'=+^)) . (III.4) 

In such case, the output is called a flat output. 


In the remainder of this paper, we assume that the window length t in ( |II.2| i is chosen such that t = k. 

Definition III.8 (s-Sparse Flat System). The nonlinear control system S^, defined by (Hu), is said to be s-sparse flat if for 
every set F C {1,... ,p} with |r| = s, the system Ep.' 


Ep 


r fft+i) 

\yd) 


= /ip 


(III.5) 


is differentially flat. 


In other words, the system is s-sparse flat if any choice of p — s sensors is a flat output. It is then straightforward to show 
that s-sparse flatness implies s-sparse r-observability. 


IV. Secure State Reconstruction Using SMT Solving 
T he secure state reconstruction problem is combinatorial, since a direct solution would require constructing the state from 
all different combinations of p — s sensors to determine which sensors are under attack. In this section, we show how using 
SMT solving can dramatically reduce the complexity of the reconstruction algorithm. 

To decide whether the combination of Boolean and nonlinear constraints in ( |II.3| l is satisflable, we develop the detection 
algorithm Imhotep-SMT using the lazy SMT paradigm 1^ . By building upon the Imhotep-SMT solver IThl . JU], our 
decision procedure combines a SAT solver (SAT-SOLVE) and a theory solver (T-SOLVE). However, differently than fTh), 
iUl . the theory solver in this paper can also reason about the nonlinear constraints in ( |II.3| ), as generated from a differentially 
flat system. The SAT solver efficiently reasons about combinations of Boolean and pseudo-Boolean constraint^ using the 
David-Putnam-Logemann-Loveland (DPLL) algorithm ll22ll to suggest possible assignments for the nonlinear constraints. The 
theory solver checks the consistency of the given assignments, and provides the reason for the conflict, a certificate, or a 
counterexample, whenever inconsistencies are found. Each certificate results in learning new constraints which will be used 
by the SAT solver to prune the search space. The complex decision task is thus broken into two simpler tasks, respectively, 
over the Boolean and nonlinear domains. 


A. Overall Architecture 

As illustrated in Algorithm [T] we start by mapping each nonlinear constraint to an auxiliary Boolean variable Ci to obtain 
the following (pseudo-)Boolean satisfiability problem; 

4>B ■= f\ ^ /\ h<S 

where Ci = 1 if \\Yi — Huffx )\\2 = 0 is satisfied, and zero otherwise. By only relying on the Boolean structure of the 
problem, SAT-SOLVE returns an assignment for the variables bi and Ci (for i = 1,... ,p), thus hypothesizing which sensors 
are attack-free, hence which nonlinear constraints should be jointly satisfied. This Boolean assignment is then used by T- 
SOLVE to determine whether there exists a state x G M" which satisfies all the nonlinear constraints related to the unattacked 
sensors, i.e. {Uli — Hu,i{x )\\2 = 0|t S supp(&)} is the set of constraints sent to T-SOLVE. If x is found, Imhotep-SMT 
terminates with SAT and provides the solution {x,b). Otherwise, the UNSAT certificate i^cert is generated in terms of new 
Boolean constraints, explaining which sensor measurements are conflicting and may be under attack. A naive certificate can 
always be generated in the form of: 

</>triv-cert = ^ > 1, (IV. 1) 

2Gsupp(6) 

* Although the term difference flatness is sometimes used in the literature for systems governed by difference equations, we choose to employ the widely 
accepted term differential flatness. 

pseudo-Boolean constraint is a linear constraint over Boolean variables with integer coefficients. 
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Algorithm 1 Imhotep- SMT 
1: status := UNSAT; 

2: (l)B ■■= ALi ^ CA A (LLl ^ 

3: while status == UNSAT do 
4: (6,c) := SAT-SOLVE((;iB); 

5: (status, x) := T-SOLVE.CHECK(supp(&)); 

6: if status == UNSAT then 

7: Aert := T-Solve.Certificate( 6, x); 

8: (/)_B := 4>B a Aert; 

9: end if 

10 : end while 
11 : return -q = (x, b); 


which encodes the fact that at least one of the sensors in the set supp(6) (i.e. for which 6^ = 0 in the current iteration) is 
actually under attack, and must be set to one in the next assignment of the SAT solver. The augmented Boolean problem is 
then fed back to SAT-SOLVE to produce a new assignment, and the sequence of new SAT queries repeats until T-SOLVE 
terminates with SAT. 

By assuming that the system is 2s-sparse flat, it follows from Theorem |III.6| that there always exists a solution to Problem [lI.l| 
hence Algorithm [T] will always terminate. However, to help the SAT solver quickly converge towards the correct assignment, 
a central problem in lazy SMT solving is to generate succinct explanations whenever conjunctions of nonlinear constraints are 
unfeasible. 

The rest of this section will then focus on the implementation of the two main tasks of T-SOLVE, namely, (i) checking the sat¬ 
isfiability of a given assignment (T-SOLVE.Check), and (ii) generating succinct UNSAT certificates (T-Solve.Certieicate). 


B. Satisfiability Checking 

It follows from the 2s-sparse flatness property discussed in Section that for a given assignment of the Boolean variables 
b, with |supp(6)| < s, the remaining p —s sensors define a flat output as; 


(U 

Vi 


7 • • • 7 




where X = supp(h). The next step is to use the flat output in order to caieulate the estimate a; — a > Pi 

Finally, we evaluate if the condition; 


Y- 


- H 


upp(b) ■^if,supp(6) 

is satisfied. This procedure is summarized in Algorithm]^ 


(a;) 


= 0 


(IV.2) 


Algorithm 2 T-Solve.Check(2:) 

1 : Construct the state estimate: 

/ (t) (t—r+l)'\ 

2 : if 11 Ur - H^^x(x )\\2 == 0 then 
3: status ;= SAT; 

4: else 

5: status := UNSAT; 

6 : end if 

7: return (status, x) 


C. Generating Succinct UNSAT Certificates 

Whenever T-SOLVE.CHECK provides UNSAT, the naive certificate can always be generated as in ( |IV.l| i. However, such 
trivial certificate does not provide much information, since it only excludes the current assignment from the search space, and 
can lead to exponential execution time, as reflected by the following proposition. 

Proposition IV.l. Let the linear dynamical system defined in ([ig be 2s-sparse observable. Then, Algorithm^which uses 
the trivial UNSAT certificate fitm-cert In ( |IV.l| l returns q = (x, b) such that: 

X* — X A supp{b*) C supp{b), 

























7 


where x* and b* are the actual system state and attack indicator vector, as defined in Section II-C Moreover, the upper bound 
on the number of iterations of Algorithm a is 0- 

Proof: Correctness of Algorithm follows directly from the 2s-sparse flatness along with Theorem II1.6| The worst case 
bound on the number of iterations would happen when the solver exhaustively explores all possible combinations of attacked 
sensors with cardinality less than or equal to s in order to And the correct assignment. This is equal to (D iterations. ■ 

The generated UNSAT certificate heavily affects the overall execution time of Algorithm [T] the smaller the certificate, 
the more information is learnt and the faster is the convergence of the SAT solver to the correct assignment. For example, 
a certificate with bi = 1 would identify exactly one attacked sensor at each step. Therefore, our objective is to design an 
algorithm that can lead to more compact certificates to enhance the execution time of Imhotep-SMT. To do so, we exploit 
the specific structure of the secure state reconstruction problem and generate customized, yet stronger, UNSAT certificates. 
First, we observe that the measurements of each sensor Yi = Hu,i{x) define a set Mi C Y as; 

M, = {x&X\Y,- HuAx) = 0}. 


It is then straightforward to show the following result. 

Proposition IV.2. Let the nonlinear dynamical system defined in ([ 113 ) be 2s-sparse fiat. Then, for any set of indices 
I C {!,... ,p}, the following statements are equivalent: 

. T-SOLVE.CheCK(I) returns UNSAT, 


The existence of a compact Boolean constraint that explains a conflict is then guaranteed by the following Lemma. 

Lemma IV.3. Let the nonlinear dynamical system defined in ([113 be 2s-sparse fiat, /f T-SOLVE.CheCK(I) is UNSAT for 
a set T, with \T\ > p — 2s, then there exists a subset Ttemp C I with \Itemp\ < p — 2s + 1 such that T -SOLVE.CHECK(Itemp) 
is also UNSAT. 


Proof: Consider any set of sensors I' d I such that \X'\ = p — 2s and HiGi' 
exist, then the result follows trivially. If the set I' exists, then: 

f| H, ^ 0 ^ IlFr - H^,xfx')\\l = 0 Vx' G f| 


is not empty. If such set I' does not 


iGl' 


iGX' 


However, since the cardinality of I' is equal to p — 2s, it follows from the 2s-sparse flatness that any state x' G Hiei' 


distinguishable using p — 2s sensors, for which we conclude that the intersection fjigi' ^ 
since T-Solve.Check(I) is UNSAT, it follows from Proposition IV.2 that: 

f| H, = 0 ^ f| H, n fl H, = 0{x'} n fl 


is a single point, named x'. Now, 


iGX 


iGX' 


iGX\X' 


iGX\X' 


which in turn implies that there exists at least one sensor i Gl\I' such that its set does not include the point x'. Now, 
we define Itemp as Itemp =X' U i and note that \Itemp\ < P — 2s + 1, which concludes the proof. ■ 

Based on the intuition in the proof of Lemma |IV.3| our algorithm works as follows. First, we construct the set of indices 
I' by picking any random set of p — 2s sensors. We then search for one additional sensor i' which can lead to a conflict with 
the sensors indexed by I' . To do this, we call T-SOLVE.CHECK by passing the set Itemp ■= T-' U i' as an argument. If the 
check returned SAT, then we label these sensors as “non-conflicting” and we repeat the same process by replacing the sensor 
indexed by i' with another sensor until we reach a conflicting set. It then follows from Lemma IV.3 that this process terminates 
revealing a collection of p — 2s -f 1 conflicting sets. Once this collection is discovered, we stop by generating the following, 
more compact, certificate: 


- E 


6 * > 1 . 


i^Xti 


Although the prescribed process will always terminate regardless of the selection of the initial set I' or the order followed 
to select i', the execution time may change. In Algorithm we implement a heuristic for the selection of the initial set I' 
and the succeeding indexes, inspired by the strategy we have adopted in the context of linear systems M- We are now ready 
to state the main result of this section. 


Theorem IV.4. Let the nonlinear dynamical system Eq defined in ([113 be 2s-sparse fiat. Then, Algorithm^using the conflicting 
UNSAT certificate ficen in Algorithm^returns rj = {x,b) such that: 

X* — X A supp(b*) C supp(b) 

Moreover, the upper bound on the number of iterations of Algorithm^is {p_ 2 g^i)- 










Algorithm 3 T-Solve.Certificate(I, a;) 

1 : Compute normalized residuals 

r, := ||y, - Hu4x)\\l / , z S Z; 

3: Sort the residual variables 

4: r_sorted := sortAscendingly(r); 

5: Pick the index corresponding to the maximum residual 

6: Ijmaxjr := Index(r_sorte(i{|x|.|i|-i,,,.,p- 2 s+i}); 

7: Ijminjr := Index(r_sorte(i{i p_ 2 s}); 

8 : Search linearly for the UNSAT certificate 

9: status = SAT; counter = 1; 

10: I_temp := I_min_r U 2_max_rcounter', 

11: while status == SAT do 

12: (status, x) := T-SOLVE.CHECK{I_temp); 

13: if status == UNSAT then 

14: </>cert := J2ielj.emp 

15: else 

16: counter := counter + 1; 

17: I_temp := I_min_r U 2_max_rcounter’, 

18 : end if 

19: end while 
20 : return (j)cen 


Proof: Correctness follows from Theorem III .6 along with the 2s-flatness condition. The upper bound on the number of 
iterations of Algorithm [T] can be derived as follows. First, Lemma IV.3 ensures that each certificate fcen has at most p — 2s + 1 
variables. Since we know that the algorithm always terminates, the worst case would then happen when the solver exhaustively 
generates all the conflicting sets of cardinality p — 2s + 1. This leads to a number of iterations equal to ■ 


V. Case Study: Securing a Quadrotor Mission 

We demonstrate the effectiveness of our detection algorithm by applying it to a waypoint navigation mission for a quadrotor 
unmanned aerial vehicle (UAV), in which the UAV needs to cross a workspace from a starting point to a desired goal. The 
dynamical model of the quadrotor and its controller, based on Il24l . are summarized below. 


A. Dynamical Model 

The dynamical model of the quadrotor consists of twelve states which are: 

• p = (px,Py,Pz) is the quadrotor center of mass in the inertial frame W (world frame). 

• V = {vx, Vy, Vz) is the quadrotor linear velocity. 

• t? = (t? 0 , is the quadrotor orientation (or attitude) expressed in terms of Euler angles: roll, pitch, yaw. 

» Lu = {uj^,uje,ojjp) is the quadrotor angular velocity. 

The quadrotor is equipped with four motors. The thrust produced by the zth motor is denoted by F) and is directly proportional 
to the rotor speed. The resulting vertical force is denoted by ui and is equal to: 

ui = Fi + F 2 + F 3 + F 4 - mg 


where m is the mass and g is the gravitational acceleration. The motors’ thrust also induce three moments, on the quadrotor 
center of mass, denoted by U 2 ,U 3 ,U 4 . These moments can be computed from the thrusts as follows: 


172 \ / hx 

^2x 

hx 

hx 

173 = -hy 

hy 

hy 

— liy 

Ui J V /7 


-P 

-P 


f Fi\ 
F 2 
F 3 

V ^4 y 


where l^x and liy are the x and y components of the distance between the motor i and the center of the quadrotor, respectively, 
and p is a constant representing the relationship between lift and drag. 
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B. Controller 

The controller is derived by linearizing the equations of motion and the motor models at an operating point that corresponds 
to the nominal hover state, i.e. p = {PxjPy,Pz), t? = ( 0 , 0 , Vj), v = ( 0 , 0 , 0 ) and ui = ( 0 , 0 , 0 ) under the assumptions of small 
roll and pitch angles, which leads to cos(t? 0 ) = cos(t?e) « 1, sin('(^ 0 ) « cj), sin(r?g) « -dg. The nominal values for the inputs 
at hover are ui = mg, U 2 = = ua = 0 . 

To control the quadrotor to follow a desired trajectory, we use a two-level decoupled control scheme consisting of a low-level 
attitude control, which usually runs at IKHz, and a high-level position control running at a lower rate 50Hz. The position 
control is used to track a desired trajectory characterized by and Using a PID feedback controller we can then control 
the position and velocity of the quadrotor to maintain the desired trajectory. Similarly, we can realize the attitude control using 
PD controllers. 


C. Securing the Quadrotor Trajectory 

The quadrotor is equipped with a GPS measuring the position vector and two inertial measurement units (IMUs), whose 
outputs are fused to generate an estimate for the body angular and linear velocities. We numerically simulate the model of 
the quadrotor and the controller. In our scenario, the quadrotor goal is to takeoff vertically and then move along a square 
trajectory. However, one of the IMU’s output, the vertical velocity sensor, is attacked by injecting a sinusoidal signal on top 
of the actual sensor readings. As shown in Fig. [T] (bottom), the attack is injected after the quadrotor has completed the takeoff 
maneuver, and only along two parallel sides of the whole square trajectory. 

To implement the secure state reconstruction algorithm, Imhotep-SMT uses an approximate discretized model of the plant 
along with the sensor measurements. To discretize the model we use the same sampling time (Tg = 20 ms) of the controller. 
Moreover, we adopt a first-order forward Euler approximation scheme which preserves the differential flatness of the original 
system. To accommodate the model mismatch due to the discrete approximation, as well as round-off errors, we replace the 
condition in line|2|of Algorithm |2| with \\Yx — Hu,i{x )\\2 < e, where we set e to 0.1 in our experiments. 

Fig. 1(a) (top) shows the effect of the attack when the quadrotor operates without secure state reconstruction algorithm. As 
evident from the two corners of the square trajectory corresponding to coordinates (2.5, 0,1) and (0, 2.5,1), the injected attack 
harmfully impairs the stability of the quadrotor, due to incorrect state reconstruction, as shown in Fig. |l(a)| (middle). Fig. |l(b)| 
(top) shows instead the trajectory of the quadrotor when operated using Imhotep-SMT to perform secure state reconstruction. 
The estimation etTor on produced by Imhotep-SMT is in the order of 10“^ m/s, and always bounded, where the bound 
depends on the error due to mismatch between the model used for estimation and the actual quadrotor dynamics (the controller 
is designed to be robust against bounded perturbations). The state and the support of the attack are correctly estimated also 
in the presence of model mismatch; the quadrotor is able to follow the required trajectory and achieve its goal. Finally, the 
average execution time of 16.1 ms (smaller than the 20ms sampling time of the position controller) on an Intel Core i7 3.4-GHz 
processor with 8 GB of memory, is compatible with several real-time applications. 


VI. Conclusions 

We have investigated, for the first time, the state reconstruction problem from a set of adversarially attacked sensors for 
a class of nonlinear systems, namely differentially flat systems. Given an upper bound s on the number of attacked sensors, 
we showed that 2s-observability is a necessary and sufficient condition for reconstructing the state in spite of the attack. We 
have then proposed a Satisfiability Modulo Theory based detection algorithm for differentially flat systems, by extending our 
previous results, reported in ua, m, to differentially flat systems. Numerical results show that secure state estimation in 
complex nonlinear systems, such as in waypoint navigation of a quadrotor under sensor attacks, can indeed be performed with 
our algorithm in an accurate and efficient way. 
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